Illinois Data Sources

Data steward:

  • Ewa Gallagher (Ewa.Gallagher@illinois.gov)

  • George Putnam (george.putnam@illinois.gov, retired)

Data provider:

  • Boldmaa Batbold (boldmaa.Batbold@illinois.gov)

Coleridge Project Manager

  • Allison Nunez (allison.nunez@coleridgeinitiative.org)
IDES
Schema table Last Updated frequency Notes
ds_il_des county_lwia_edr 2024-06-13 Ad Hoc
ds_il_des il_qcew_2018q3_present Q2 2024 Quarterly
  • Need to add the column quarterly_version and set that to ‘Final’
  • raw file is named iles.csv
  • For the time being we need to ingest qcew data into both tables until George gives us the green light to delete one of them.
ds_il_des il_qcew_2018q3_present_processed_20231115 Q2 2024 Quarterly
  • Need to add the column quarterly_version and set that to ‘Final’
  • raw file is named iles.csv
  • For the time being we need to ingest qcew data into both tables until George gives us the green light to delete one of them.
ds_il_des il_qcew_employers Quarterly
ds_il_des ind_mapping
ds_il_des labor_by_county
ds_il_des monthly_ui_wage_employer
ds_il_des monthly_ui_wage_not_allocated
ds_il_des monthly_ui_wage_worker 21 June 2024 Monthly
  • file name is yearqtrFinalWorker.txt
  • Need to add the column version and set that to ‘Final’
  • data skips every 3rd month
ds_il_des monthly_ui_wage_worker_prev
ds_il_des promis_certified 27 June 2025 Weekly
  • Need to add week variable to every table before ingesting. There is a scirpt for this. Use the date in the file name.
  • Run dashboard scripts.
ds_il_des promis_initial 27 June 2025 Weekly
  • Need to add week variable to every table before ingesting. There is a scirpt for this. Use the date in the file name.
  • Run dashboard scripts.
ds_il_des promis_initial_new_overlap
ds_il_des promis_initial_prev
ds_il_des quarterly_wage 21 June 2024 Quarterly
  • Need to add the column quarterly_version and set that to ‘final’
  • Need to add the column il_wage_person_id and set that to NULL
  • Need to add the column id and set that to NULL
ds_il_des quarterly_wage_2018q3
ds_il_des quarterly_wage_2018q4
ds_il_des quarterly_wage_2019q1
ds_il_des quarterly_wage_2019q2
ds_il_des quarterly_wage_2019q3
ds_il_des quarterly_wage_2019q4_v2
ds_il_des quarterly_wage_2020q1_v2
ds_il_des quarterly_wage_2020q1_v3
ds_il_des quarterly_wage_2020q2_v2
ds_il_des quarterly_wage_2020q2_v3
ds_il_des quarterly_wage_2020q3
ds_il_des quarterly_wage_prev
ds_il_des region_lookup
ds_il_des resea
ds_il_des st_il_cert_030522
ds_il_des st_il_final_worker_202201
ds_il_des st_il_final_worker_202202
ds_il_des st_il_initital_promis081520
ds_il_des st_ilul2102

Dashboard updates

  • Upon ingesting the promis_certified and promis_initial data we also need to update the dashboards.
  • Don’t make blank values as NULL
  • check values upon ingestion each week